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In  a  previous  paper  a  new  bivariate  failure  model  was 
introduced  and  its  properties  investigated.  In  this  paper 
we  consider  estimation  of  the  parameters  of  this  model  in 
a  special  case,  for  both  complete  and  incomplete  samples. 
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1.  Introduction.  Many  biv  riate  exponential  distributions 
have  been  suggested  in  the  literature.  These  distributions 
differ  in  the  various  properties  that  describe  them.  One  of 
the  properties  that  it  is  natural  to  demand  of  such  a  distri¬ 
bution  is  that  it  possess  exponential  marginals,  and  many  of 
the  proposed  distributions  have  this  property  including  those 
suggested  by  Gumbel  [6] ,  Downton  [4] ,  Hawkes  [7] ,  and  Marshall 
and  Olkin  [8 ] . 

Another  highly  desirable  property  is  the  lack  of  memory 
property.  In  the  univariate  case  this  property  is 

Pr{S>s+t)  =  Pr(S>s)  Pr{T>t} 

for  all  s,  t  >  0  and  is  enjoyed  only  by  the  exponential  dis¬ 
tribution.  The  natural  extension  of  this  property  to  two 
dimensions  is  that 

Pr{S>s]L+t1,  T>s2  +  t2)  ')r{S>s1,  T>s2 }  Px{S>t1,  T>t2) 

for  all  s ^ ,  t^,  s2,  t2  _>  0.  However,  this  definition  is  too 
restrictive  to  be  useful.  Marshall  and  Olkin  [8]  have  shown 
that  the  joint  distribution  of  two  independent  exponential 
distributions  is  the  only  distribution  that  has  this  property. 
Consequently,  they  define  the  bivariate  lack  of  memory  pro¬ 
perty  (LMP)  as  Pr(S>A+s,  T>A+t} 

=Pr(S>A,T>A}  Pr  (S>s,  T>t}  for  all  s,  t,  A  _>  u.  Unfortunately, 
this  definition  does  not  yield  a  unique  distribution.  In 
addition  to  Marshall  and  Olkin  [8] ,  distributions  that  have 
this  property  include  those  of  Freund  [5]  and  Block  and  Basu  [1]. 
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The  model  proposed  by  Marshall  and  Olkin  [8]  has  both 
exponential  marginals  and  the  LMP  and  is  the  most  widely  re¬ 
ferenced  bivariate  failure  model.  Their  survival  distribution  is 

Pr(S>s,  T>t}  =  exp(-X1s-X2t-X12  max  (s,t))  for 

,t  >_  0  and  fixed  parameters  X^,X2,X^2  >  They  show  that  this 
distribution  is  the  only  one  with  both  of  the  properties.  Note 
that  in  this  model  Pr{S=T}  =  X^2/ (X1  +  X2+X^2) >0, so  that  there 
is  a  singular  component  in  the  distribution.  Computationaly 
this  poses  some  difficulties,  but  these  can  be  overcome. 
Furthermore,  this  model  can  handle  the  simultaneous  failure  of 
both  components.  Also,  in  this  model, 

Pr {S>s+A | S>s ,  T>s}  =  Pr{S>s+A|S>s,  T<_s} 

which  implies  that  conditioned  on  the  fact  that  one  component 
if  functioning  at  time  s,  the  distribution  of  its  residual 
lifetime  is  independent  of  whether  or  not  the  other  component 
has  failed.  Freund  (5]  has  derived  a  bivariate  failure  dis¬ 
tribution  using  the  assumption  that  at  the  failure  of  one  com¬ 
ponent  the  distribution  of  the  residual  lifetime  of  the  other 
component  is  changed.  The  marginal  distributions  in  Freund's 
model  are  not  exponential  but  are  mixtures  of  exponentials. 

In  a  previous  paper  [9]  Freund's  model  was  generalized  and  some 
of  the  properties  of  the  new  bivariate  failure  model  were  in¬ 
vestigated.  Here  we  consider  a  special  case  of  the  new  model 
with  special  reference  to  estimating  its  parameters.  The 
model  is  defined  in  section  2  and  the  first  two  moments  are 
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X  if 

X  <  Y  [X  +  V 

if 

X 

<  Y 

s  =  • 

»  T  =  • 

Y  +  U  if 

X  >  Y  [y 

if 

X 

<  Y 

calculated.  In  section  5,  the  survival  distribution  and  the 
LMP  are  discussed. 

Maximum  likelihood  estimation  is  taken  up  in  section  4. 
Explicit  expressions  for  the  estimators  are  given.  Properties 
of  these  estimators  are  derived  in  section  5  including  their 
joint  asymptotic  distribution.  Finally,  in  section  6,  maximum 
likelihood  estimation  is  discussed  for  an  incomplete  sample. 

2.  Model  Definition  and  Moments.  Let  A  and  B  be  two  components 
of  a  system  with  lifetimes  S  and  T  respectively.  For  given  ran¬ 
dom  variables  X,  Y,  U,  V  we  write 


(2.1) 


Here  we  take  X,  Y,  U,  V  to  be  mutually  independent  with  X  dis¬ 
tributed  as  exponential  with  parameter  a,  Y  distributed  as 
exponential  with  parameter  3.  Let 

Pr{U>t}  =  qe  a  t  and  Pr{V>t)  =  qe  ®  1 , 

where  a,B,a*.B'>0  and  0<q<L.  Freund's  model  corresponds  to  the  case 
when  q  =  1.  The  parameter  q  allows  for  simultaneous  failure 
of  the  components,  since  Pr(S  =  T}  =  1-q  =  p. 

Tosch  and  Holmes  [9]  have  discussed  this  model  without 
distribution  assumptions  and  have  derived  (among  other  things) 
the  Laplace-Stielt j es  (L-S)  transform  of  the  joint  distribution 
of  S  and  T.  We  now  state  a  result  from  that  paper  that  will  be 
used  in  the  present  context. 


t. 


. . . 
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Lemma  1 : 

If  X  -  exp  (a)  and  Y  ~  exp(B)>then. 

i)  f* (a,b)  =  la£vfb^  +  where  f*(a,b) 

is  the  transform  of  the  joint  distribution, 

ii)  E (S)  =  ^  [ 1+BE(U) ] . 

iii)  Var(S)  =  — L-  [  l  +  02Var  (U)  +  aBE  (U2)  ]  , 

(a+B  ) 

ivj  Cov (S ,T)  =  — - — T  [l-aBE(U)E(V)]. 

(a+B) “ 

In  this  specific  case  f"  (a)  =  P+  ,  fy(b)  =  p  + 

E(U)  =  ~t  ,  E(U2)  =  -—-a-  and  Var(U)  =  — .  By  substituting 

(<*’)  (<*')“ 
these  quantities  into  Lemma  1  we  see  that 


Theorem  2:  For  the  given  model 


(a ,b)  = 


a+B+a+b 


[p(a+B) 


r  Cta*  . 
lb+3' 


ii) 

E(S)  » 

aj 

a' 

'+3q 

'(a+a)  , 

iii) 

Var (S) 

= 

1 

2  2 

[(«' 

1 ) “  +  qB  (2-qB+2a) ] , 

(a' ) “ (a+B) ” 

iv) 

Cov (S , 

T) 

1 

> 

r  [a’ 

S’ -q2aB) . 

a ' B ' (a+B) 

The  moments  of  T  follow  similarly.  As  in  Freund's  model 
the  correlation,  p(S,T),  is' seen  to  vary  between  -i  and  1. 

3.  Survival  Distribution  and  the  Lack  of  Memory  Property. 
To  arrive  at  the  survival  distribution  we  again  c:-il  upon  a 
result  for  the  general  case. 
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Lemma  3 : 


Fx(t ) FY Ct)  +  fl  Fv(t-x)FY(x)dFY(x)  if  s<t 


s  V 


F(s,t)  =  Fx(s)Fy(s) 


Thus  for  s>t  we  have 


if  s=t 


Fx(s)Fy(s)  +  /*  Fu(s-y)Fx(y)dFy(y)  if  s>t 


F(s,t)  =  e'(a+B)s  +  /*  qe'a' ~a^£e~^dy 

=  e‘(a+6)s  +  q8e"a' s  fst  e^a+6-a')>rdy 

_  „ -  (a+0)s  ^  q8e"a  5  r^-(a+g-a')t  ^-(a+B-a')s-, 
"  e  a+8-a'  16  ‘e  J 


(3.1) 


The  last  equation  assumes  that  ct+B-a’4  0.  If  a+8-a'  =  0 
then  (3.1)  becomes 

F(s,t)  =  e*(a+$)s  +  qge"a  s  (s-t),  if  s>t.  (3.; 


For  the  remainder  of  the  paper,  it  will  be  assumed  that 
a+B-a'vO  and  also  that  a+B-B’^O.  The  calculations  are  similar 
when  s<t,  so  that 


Theorem  4: 


F(s,t)  = 


-B't 


- (a+8) t  +  qae_  { Q- (a+S-B ’ ) s _fi- (a+B- B ’ ) t}  if  s<t> 


a+B  *  B 


(a+B) s 


if  s=t, 


(a+B) s  +  qBe  a  f  - (a+B-a' ) t  -  (a+S-af ) s,  i£  t 
a+B-ar  1  . 


The  marginals  are  given  by 


Corollary  5: 


/ 


i)  Fs(s) 
ii)  FT(t) 


g+pg-g 1  -(g+B)s  +  qB  -a's 

g+6-g'  e  g+B-g' 


g+Bpg-B'  -(a+B)t  qa  -B't 

g+B-B'  g+B-B' 


We  see  that  the  marginals  are  mixtures  of  exponentials. 


Theorem  6: 


The  survival  distribution  given  in  Theorem  4 


has  the  LMP. 

Proof:  We  must  show  that  F(s+A,  t+A)  =  F(s,t)F(A,A)  for 
all  s ,  t ,A  >  0. 


If  s=t  then  s+A  =  t+A  and  F(s+A,  s+A)  =  e 


(g+B) (s+A) 


=  e 


-(«*6)se-(a*B)4  .  F(s.s)F(i,4) 


If  s<t  then  s+A  <  t+A  so  that 


Ffs*4,t.4)  =  [e-(“4S-S'5<s4« 


g+S-B’ 


_e-(g+S-B') (t  +  A)  j 


=  e 


- (g+Bb)A^e- (a+B)t  +  qge 


-8 ’ (t+A) 


g+B-B ’ 


(e‘ 


(g+B-B 1 )  s  8  ’  A  - (a+3- 3 ’ ) t  8' A 


e  -e 


e  u)  ] 


- (a+B) A ,  - (a+B) t  gge'B  1  f  - (a+B-B’)s  - (g+S-3’ )t 


=  e 


I  K'-’-  VJ'-  +  re 

le  a+6-6’  1 


)] 


=  F(A, A) F (s ,t) .  The  result  follows  similarly  for  s>t 


QED 


4.  Maximum  Likelihood  Estimation.  The  measure  determined  by 
the  survival  function  is  not  absolutely  continuous  with  respect 
to  ^2?  Lebesgue  measure  on  R^.  Therefore,  there  does  not 
exist  a  probability  density  function  (pdf)  for  (S,T)  with 
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respect  to  Bhattacharrya  and  Johnson  [2],  when  dealing 

with  estimation  in  the  Marshall-Olkin  model,  overcame  this 
problem  by  considering  the  following  measure  on  R*  ,  where 

1*2  =  f  O.y)  I  x>0,  y>o)  • 

Let 

y (A)  =  m2(A)  +  u x ( { x |  x>0 ,  (x,x) eA}) ,  (4.1) 

where  y^  is  Lebesgue  measure  on  R^.  This  measure  will  suffice 
for  our  purpose  here  also.  The  measure  y  is  o- finite  on  R*  and 
the  measure  determined  by  the  survival  function  is  absolutely 
continuous  with  respect  to  y.  It  can  be  shown  that 


Theorem  7 :  The  pdf  of  (S,T)  with  respect  to  y 


f(s,t)  = 


U'qe't11*  ■)s-S't 

p  (cc+8)  e"  (a+b) s 
8u 'qe~ ta+S-a' ) t-a' s 


is  given  by 

if  s<t, 

if  s  =  t , 
if  s>t. 


We  are  now  in  a  position  to  write  down  the  likelihood  function 

with  respect  to  y.  Consider  a  sample  of  N  observations 

(  (S1 » 1 1 ) ,  (s?t?)  , . . .  ,  (s^:,t^) } .  The  likelihood  function  is 
N 

L  =  it  f  (si,ti) .  The  following  notation  will  simplify  the 
i  =1 

expression. 


N2  *  '{(Sj.tj) |Sj>t1> , 

N,  -  *{ (s1,ti) |Sj  =  ti}, 


Si  -  2  s 

si<ti  x’ 


S  -  I  s 


R  =  s  =  t  Si’ 
si  1  1 


Ti  ’  si«i 


T„  =  \  t-,  where  SA  is  the  number  of 

2  Sj>t  i 


items  in  the  set  A.  In  this  notation 
N.  N, +N_  N-  N  N7 

L  =  (oB*)  (1-p)  “P  (a+S)  J(ctB')  iexp[-(o+S)(S1+R+T2)-«,(S 


-B'fTj-Sj)].  (4.2 

Let  l  =  be  the  log  likelihood  function.  Then 
l  =  N1Hn(a)  +  N  yf)  +  (Nj+N,Hn(l-p)  +  N-ln(p)  +  N_Zn(a+S) 

+  X2ln($)  +  N2iln(a,)-(a+S)  (Sj  +  R+T,^’ fS?-T2)-3’ (T^S^  (* 

Let  e  =  (01,e2,e3,04,e5)  =  (a,g,a' ,S’ ,p)  to  be  the  vector  of 
unknown  parameters.  The  likelihood  equations  are  then 
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(4.4) 


Nj/ct  +Nl5/(a+B)-(S1  +  R+T7)  =  0, 
N2/B  +  N,/ (a+3) - (S1+R+T?)  =  0: 

N2/a' - (S?-T?)  =  G, 

Nj/B’-CTj-Sj)  =  0, 

-(N1+N2)/(l-p)  +  N/p  =  0. 


By  solving  these  equations  we  can  obtain  the  maximum  likelihood 
estimates. 

Theorem  8: 


i)  If  N,  =  N 2  =  0  (so  that  N_  =  N)  ,  then  {5=1  and 
a,  8,  a',  8*  cannot  be  estimated. 

ii)  If  =  0,  but  N 7 4 0 ,  then  p  =  N_/N ,a  =  Q,  8  =  g-~x|rry 

a’  =  N,/ (S? -T7)  j;  and  S'  cannot  be  estimated, 
iii)  If  N',+0,  but  N?  =  0,  then  6  =  .\S_/N,  S  =  0,  d  =  f ~~n r? 

i  i 

A 

6*  =  Nj/(T^-S^) ,  and  a’  cannot  be  estimated, 
iv)  If  Nj  j  0  and  =  0,  then 

N  ^*i 

Sx  +  R+T7  j  ’ 

N 

B  =  S.  +R+T^  *■  N.+N^  ’  ’ 


S2‘T2  ’ 


T  -S  ’ 

ll  ^  I 
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Proof  of  iv) :  The  parameter  space  is  ft  =  { (a , $ ,a ' ,8 ' ,p) | 
a>0 , 8>0 ,a' >0 , 8 ' >0 ,  0<p<l}.  On  the  boundary  of  9.,  L  =  0. 

All  of  the  partial  derivatives  of  L  exist  and  are  continuous 
on  the  interior  of  S2.  Finally  L  >  0  on  the  interior  of  ft  given 

A  A 

that  N^fO,  +  Therefore  since  (d ,  6 ,6c',  B'  ,  p)  is  the  unique 
point  where  the  gradient  vanishes,  L  must  attain  its  maximum 
at  that  point.  Q.E.D. 


5. Properties  of  the  Maximum  Likelihood  Estimates 
Theorem  9: 

i)  E(&)  =  (N /  (N-l)  )a , 

ii)  E  (8)  =  (N/  (N- 1) )  8  , 

iii)  E(p)  =  p. 

Proof:  First  the  following  two  observations  are  made: 

has  a  trinomial  distribution  with  parameters 


(N, 


qq  _qj3  . 
a+8  ’  a+8  ’  J  ’ 


(5.1) 


(N^jNj  has  a  binomial  distribution  with  parameters 


fN'N3'  5%’  • 


(5.2) 


u  E(f E(E<KpT^IN3»  - 

'  EfFRT7(N'N3')a:f6''1  by  ,(5-25 


a 

a+8  " 
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Now  S.+R+T-  can  be  written  as  £  minis., t.),  but 
12  i=l  1  1 

minCs^jt^)  has  the  sane  distribution  as  min(X,Y)  ~exp(a+B) 
so  that  S^+R+T2  has  an  Erlang  distribution  of  order  N  and 
parameter  a+$.  Therefore 


,  N  N  - 1 


Er _ =  N/°°  I  (a+S)  X  -(a+B)x  d  =  f_N_w  6l 

LlS1+R+T0J  J0  x  (N-l)  !  dx  (-N-lna 
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1X1 1 

Finally  S1+R+T2  is  independent  of  so  that 

E(S)  =  =  E(spKir2)E<iT-i^)  independence 

NrT(a+B,aTe  =  (iPT)a  • 


ii)  E(8)  follows  similarly, 

N-  N 

iii)  E(p)  =  E (— jq—  =  g-  by  (5.1) 


Q .  E .  D . 


In  like  fashion  it  can  be  shown  that 


Theorem  10 


i)  E(a* |N7)  =  (n-ryja* 


if  N2>1, 


ii)  ECB'INj)  = 


if  N1>1. 


Using  a  Lehmann,  Scheffi  partioning  operation  (c.f.  Zacks  [10], 
p.  50)  it  can  be  shown  that 

Theorem  11:  The  vector  (N-^,  N2,  S^  +  R+T2,  is  a 

minimal  sufficient  statistic  of  the  sample  (s^,t^) , . . . , (S^,t^) }. 
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Fi'om  this  we  see  that  the  vector  of  maximum  likelihood  estimates 
is  also  a  minimal  sufficient  statistic. 

To  investigate  the  asymptotic  properties  of  the  maximum 
likelihood  estimate,  we  will  use  the  conditions  presented  by 
Chanda  [3,  p.  56].  Of  the  three  conditions,  the  first  two  are 
the  usual  Cramer-Rao  regularity  conditions.  To  establish  these 
results,  we  need  to  choose  a  5-dimensional  interval  £2* ,  which 
contains  the  true  values  of  the  parameter. 

Let 

£2*  =  {6  |  0<ei<6i<Mi«»,  i  =  1,2, 3, 4, 5} 

for  some  pre-chosen  constants  i  =  1,  2,  3,  4,  5. 

-  9  10 

Here  M^<1.  For  instance,  if  =  10  and  =  10  ,  we  restrict 

- 1 0  9 

the  mean  of  X  to  (10  ,  10  ).  From  physical  considerations, 

we  can  certainly  arrive  at  the  necessary  bounds.  In  £2*,  it  is 

straightforward  to  obtain  the  necessary  dominating  functions. 

The  third  condition  requires  the  positive  definiteness  of  the 

information  matrix.  We  begin  by  finding  the  Hessian  matrix  Q. 

Let  Q  =  (qiJ,  where  qi  -  =  -g— ,  l  is  the  log  likelihood 
J  J  iu  j 

function  (4.3)  and  0  =  (a, 8, a’, 6',  p) .  By  direct  calculation 
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N1  +  N3 
o'2”  (a+6)2 


N. 


(a+B) 


N- 


(a  +  B) 


".2  + 

B2  (a+B) 2 


0  0 


0  0 


1 


-Q  = 


(a')2 


(5.3) 


(a')2 


I 

l 


0  0 

(1-P) 


2  + 


Note  that  in  ft* ,  0<p<l.  The  information  matrix  z'1  =  E(-N_1Q) 
can  now  be  evaluated.  Since  EfNj)  =  (~g)N ,E(N?)  =  (^)N,  and 


E ( N - )  -  p1^,  we  have 


[  ,  i»  ^  H  . . 
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Theorem  12: 


0v,  ■*  0  as  with  probability  one. 


Theorem  13: 

1/2  ~ 

N  (0^,-0)  is  asymptotically  distributed  as  multi- 
varitate  normal  with  mean  0  and  convariance  matrix  2 . 

6.  Estimation  with  an  Incomplete  Sample.  Suppose  that  we  have 
an  incomplete  sample,  that  is,  some  of  the  components  do  not 
fail  in  the  alotted  time.  Again  let  N  be  the  total  number  of 
samples  taken  and  let  N^,  N2,  ,  S^,  S2  ,  R,  T^,  T2  be  as 

before.  Let  be  the  time  when  component  A  failed  or  the  time 
that  the  i—  experiment  was  stopped,  if  A  did  not  fail.  Similarly 


for  t^,  Let 


=  #{(s^,t^)|A  failed  by  B  did  not}, 

M2  =  #{(s^,t^)|A  did  not  fail  but  B  did}, 
=  #  (si,ti) [neither  A  nor  B  failed}, 


sum  of  s.'s  when  A  failed  but  B  did  not, 

l 


sum  of  s^'s  when  A  did  not  fail  but  B  did. 


sum  of  t^'s  when  A  failed  but  B  did  not 


sum  of  t..'s  when  A  did  not  fail  but  B  did, 


R'  =  sum  of  s^'s  when  neither  A  nor  B  failed. 


We  want  to  obtain  the  likelihood  elements  for  these  incomplete 
samples.  The  following  is  derived  directly  from  the  survival 
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function . 


Lemma  14; 


i)  for  s<t,  Pr{S=s,  T>t}  = 


3F(s,t) 

3s 


„  -B't-  (a+B  -  8  ’ )  s  , 

qae  as 


ii)  for  s  =  t,  Pr{S>s,  T>t}  =  e  ^a+^s 
iii)  for  s>t,  Pr{S>s,  t=t}  =  qBe"a  s'(a+£"a  ^dt. 


The  likelihood  function,  L,  can  now  be  obtained. 

N,  +M,  N.  N,  +N7+M,  +M7  N_  N_  N-+M-  N2 
L  -  a  1  1  (8' )  A(l-p)  1  L  1  2p  3 (a+B)  36  2  2(a’) 

’  exp  [  -  (a+B)  (S1  +  R+T2+S^R*+T2)-a'(S2-T2+S2'T’)-B,(T1-S1+T’-s’)].  (6.1) 

If  we  let  £  =  £^L  be  the  log  likelihood  function,  the  likelihood 

3£ 

equations  are  given  by  =  0,  i  =  1,2, 3, 4, 5.  Again  the 

I 

likelihood  function  is  zero  on  the  boundary  and  positive  on 
the  interior  of  the  parameter  space.  Therefore  the  unique 
solution  to  the  likelihood  equations  is  the  maximum  likelihood 
estimate.  Excluding  the  cases  where  some  of  the  parameters 
are  not  estimable,  we  have 


Theorem  15:  The  maximum  likelihood  estimates  in  the  incomplete 
sample  are  given  by: 


a  = 


N, +M, +N7+M9+N-  M-  +M_ 

1  1  2  2  o  r  l  2  t 

Sl  +  R+T2  +  Si  +  R’+T2  1M1+m1+n7+*m2J  ’ 


Nl+Ml+N2+M2+N3 


M 

V  2 


a  = 


Sl+R+T2+Si+R'+T2  in1+m1+n2+M2^ 

V<VVVV' 


8’  =  Nj/tTj-S^-Sp, 

A 

P  =  n3/(n1+n2+m1+m2+n5). 
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7.  Discussion .  The  model  presented  differs  from  Freund's 
model  in  the  addition  of  another  parameter  to  include  the 
possibility  of  simultaneous  failure  of  both  components.  In 
biological  applications,  this  could  be  the  simultaneous  loss 
of  paired  organs  by  some  catastrophe  or  disease. 

In  Marshall  and  Olkin's  model,  the  residual  lifetime  of 
one  component  is  independent  of  whether  or  not  the  other  com¬ 
ponent  has  failed.  This  is  not  true  of  the  proposed  model. 

In  many  applications,  the  failure  of  one  component  puts  more 
(possibly  less)  strain  on  the  remaining  one,  i.e.,  when  one 
kidney  fails.  Lastly,  Marshall  and  Olkin’s  model  allows  only 
for  positive  correlation  in  the  component  lifetimes,  while 
the  proposed  model  allows  for  some  negative  correlation  as 
well . 
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